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Abstract. We study invertibility of matrices of the form D + R where D is an arbitrary 
symmetric deterministic matrix, and i? is a symmetric random matrix whose independent 
entries have continuous distributions with bounded densities. We show that \\{D + R)^^\\ = 
O(n^) with high probabihty. The bound is completely independent of D. No moment 
assumptions are placed on i?; in particular the entries of R can be arbitrarily heavy-tailed. 



1. Introduction 

This note concerns the invertibihty properties of n x n random matrices of the type D + R, 
where D is an arbitrary deterministic matrix and i? is a random matrix with independent 
entries. What is the typical value of the spectral norm of the inverse, \\{D + 

This question is usually asked in the context of smoothed analysis of algorithms [9J. There 
D is regarded as a given matrix, possibly poorly invertible, and R models random noise. 
Heuristically, adding noise should improve invertibility properties of D, so the typical value 
\\{D + should be nicely bounded for any D. Sometimes this is true, but sometimes 

not quite. 

This is indeed the case when i? is a Ginibre matrix, i.e. the entries of R are independent 
iV(0, 1) random variables. A result of Sankar, Spielman and Teng [lOj states that 



P 



|||(L> + i?)-i > tv^} < 2.35/t, t>0. (1.1) 



In particular, \\{D + R) ^\\ = 0{^/n) with high probability. Note that this bound is in- 
dependent of D. It is sharp for D = 0, since ||-R~^|| > with high probability ([1], see 

For general non-Gaussian matrices R a new phenomenon emerges: invertibility of D + R 
can deteriorate as \\D\\ — )■ oo. 

Suppose the entries of R are sub-gaussiaE0 i.i.d. random variables with mean zero and 
variance one. Then a result of Rudelson and Vershynin [6j (as adapted by Pan and Zhou 
[5]) states that as long as \\D\\ = 0{^/n), one has 

P| II (D + i?)"! > tv^l < C/t + c", t>0. 

Here C > and c G (0, 1) depend only on a bound on the sub-gaussian moments of the 
entries of R and on ||Z}||/A/n. 
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"'^See [14) for an introduction to sub-gaussian distributions. Briefly, a random variable X is sub-gaussian 
if p^^/^(E|Ar|P)^/P < A' < oo for all p> I; the smallest K can be called the sub-gaussian moment of X. 
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Surprisingly, sensitivity to \\D\\ is not an artifact of the proof, but a genuine limitation. 
Indeed, consider the example where each entry of R equals 1 and —1 with probability 1/4 and 
with probability 1/2. Let D be the diagonal matrix with diagonal entries (0, d,d, . . . ,d). 
Then one can sho\M3 that \\{D + > d/y/n with probability 1/2. In particular, \\{D + 

R)^^\\ ^ \/n as soon as \\D\\ = d^ n. 

Note however that the typical value of \\{D + -R)~^|| remains polynomial in n as long as 
\\D\\ is polynomial in n. This result is due to Tao and Vu [121 El US]; Nguyen |1] a proved 
similar result for symmetric random matrices R. 

To summarize, as long as the deterministic part D is not too large, = 0{y/n), 

Sankar-Spielman-Teng's invertibility bound (11. ip remains essentially valid for general random 
matrices R (with i.i.d. subgaussian entries with zero mean and unit variance). For very large 
deterministic parts (||-D|| n), the bound can fail. It is not clear what happens in the regime 
v^< \\D\\ <n. 

Taking into account all these results, it would be interesting to describe ensembles of 
random matrices R for which invertibility properties of D + R are independent of i^. In this 
note we show that if the entries of a symmetric matrix R have continuous distributions, then 
the typical value of \\{D + -R)~^|| is polynomially bounded independently of D; in particular 
the bound does not deteriorate as \\D\\ — )■ oo. 

Theorem 1.1. Let A be annxn symmetric random matrix in which the entries {^jj}i<j<j<Ti 
are independent and have continuous distributions with densities bounded by K . Then for 
all t>0, 



Since we do not assume that the entries have mean zero, this theorem can be applied to 
matrices of type A = D + R, and it yields that \\{D + R)^^\\ = Oin^) with high probability. 
This bound holds for all deterministic symmetric matrix large and small. We conjecture 
that the bound can be improved to 0{^/n) as in Sankar-Spielman-Teng's result (II. ip . 



Remark 1.2. We do not place any upper bound assumptions in Theorem 11.11 either on the 
deterministic part D or the random part R. In particular, the entries of R can be arbitrarily 
heavy-tailed. The upper bound K on the densities precludes the distributions concentrating 
near any value, so effectively it is a lower bound on concentration. 

Remark 1.3. A result in the same spirit as Theorem 11.11 was proved recently by Rudelson 
and Vershynin [7] for a different ensemble of random matrices i?, namely for random unitary 
matrices. If R is uniformly distributed in U{n) then 



As in Theorem II. H D can be an arbitrary deterministic n x n matrix; C,c > denote 
absolute constants (independent of D). 

Remark 1.4. For the specific class where D is a multiple of identity, sharper results are avail- 
able than Theorem 11.11 In particular, results by Erdos, Schlein and Yau |2] and Vershynin 
[15] yield an essentially optimal bound on the resolvent, \\{D — zr)~^\\ = 0{^Jn). 




(1.2) 



P<^ II {D + R)-^ II >tn^\ < t-^, t > 0. 




This example is due to M. Rudelson (unpublished); a similar phenomenon was discovered independently 
by Tao and Vu [13]. 
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Remark 1.5. While Theorem 11.11 is stated for symmetric matrices, it holds as well for Her- 
mitian matrices. The proof for the Hermitian case only requires an easy change to the proof 
of Lemma 12.11 below. 

In the rest of the paper, we prove Theorem 11.11 The argument is very short and is based 
on computing the influence of each entry of A on the corresponding entry of A~^. 

2. Proof of Theorem 11.11 
Recall that the weak Lp norm of a random variable X is 

||X||p,oo := supt(P{|X| > t})^/^, 0<p<oo. (2.1) 

t>o 

Lemma 2.1. Let A be the random matrix defined in Theorem \l.l[ Then for all 1 < i, j < n, 

\\Ar^\\i,oo<2K. 

Proof. Recall the Jacobi formula, which is valid for an arbitrary square matrix A = A{t) 
that depends on a parameter t: 

Here and later \A\ denotes the determinant and adj(y4) denotes the adjugate matrix of A. 
Let be the submatrix obtained by removing the i*'^ row and j*'^ column of A, and let 
A{ij),{k,i) be the submatrix obtained by removing rows i and k and columns j and / from A. 

Consider the off-diagonal case first, where i ^ j. The Jacobi formula yields jj—\A(^ij)\ = 
(-l)*+^|y4(ij)^(j-i)|, SO that 

IAm)I = (-1)^^'IAm),0-.)IA.+« (2.2) 
for some constant a (by this we mean that a does not depend on Aij). Further, 
d 

dAij 

Thus, for some constant b one has 

\A\ = + {-iy^^2aA, + b. (2.3) 

Equations 02.21) and (12. 3p and Cramer's rule imply that for all {i,j) there exist constants 
p, q such that 

X 



\A\ = (-l)^+^-(|A(,,)| + |A(,.,)|) = (-l)^+^2|yl(,,-)| = 2|A(,,),(,,)|A,, + (-l)^+^2a. 



I A,j I 



\A\ 





Aij + p 




\\Aij+p 





X^ + q 



where X = Aij + p. 



First, assume that g > 0. Then \A^j\ < 1/\X\, and thus we have for all t > 0: 

j\>t} <F{\X\ <l/t} <2K/t. (2.4) 



Next, assume > g =: — s; then 



\X-s/X\ 

Note that the function f{x) := x — s/x satisfies f'{x) = 1 + s/x^ > 1 for all x 0. Thus the 
set of points {x G M : |/(x)| < e} has diameter at most 2e for every e > 0. When x = X is 



a random variable with density bounded by K, it follows that P{|/(X)| < e} < 2Ke. Using 
this for e = 1/t, we obtain 

n\Al}\>t}<F{\fiX)\<l/t}<2K/t. 

We have shown that in the off-diagonal case i ^ j, the estimate fl2.4p always holds. 

The diagonal case i = j is similar. The Jacobi formula (or just expanding the determinant 
along i-th row) shows that \A\ = j + c for some constant c. Then a similar analysis 

yields P{|4~/| > t} < 2K/t. This completes the proof. □ 

Proof of Theorem Although the weak Li norm is not equivalent to a norm, the following 
inequality holds for any finite sequence of random variables Xj: 

<45^||X,|K,^. (2.5) 

/ l.oo •^"^ 

i ' i 

This inequality is due to Hagelstein (see the proof of Theorem 2 in [3]); it follows by a 
truncation argument and Chebychev's inequality. We use (12. 5p together with the estimates 
obtained in Lemma [2. II to bound the Hilbert-Schmidt norm of A: 

The definition of the weak Li norm then yields 

suptP{||v4-^||Hs >t} < %Kn^. 

Since \\A\\ < ||A^^||hs, the proof of Theorem 11.11 is complete. □ 
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